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Abstract 



O: 

OO ■ We consider the almost sure asymptotic behavior of the periodogram of stationary and ergodic se- 

quences. Under mild conditions we establish that the limsup of the periodogram properly normalized 
identifies almost surely the spectral density function associated with the stationary process. Results 
■ for a specified frequency are also given. Our results also lead to the law of the iterated logarithm 
p ^ ■ for the real and imaginary part of the discrete Fourier transform. The proofs rely on martingale ap- 
proximations combined with results from harmonic analysis and technics from ergodic theory. Several 
applications to linear processes and their functionals, iterated random functions, mixing structures 



^2 ■ and Markov chains are also presented. 

1 Introduction 

• The periodogram, introduced as a tool by Schuster in 1898, plays an essential role in the estimation 

, of the spectral density of a stationary time series {Xj)j(^i of centered random variables with finite 

■ second moment. The finite Fourier transform is defined as 

in 

O; ^„(t) = Ve"=*Xfc, (1) 



fe=l 



where i = \/— 1 is the imaginary unit, and the periodogram as 

In{t) ^ ^\Sn{t)\^ ie[0,2^]. (2) 

It is well-known since Wiener and Wintner that for any stationary sequence {Xj)j^z in 
(namely E|Xo| < oo) there is a set ft' of probability one such that for any t G [0, 27r] and any ui e fl' , 
Sn{t)/n converges. To provide the speed of this convergence many authors (see Peligrad and Wu 
|21j and the references therein) established a central limit theorem for the real and imaginary parts 
of Sn(t)/\/n under various assumptions. Recently, Peligrad and Wu [21] showed that, under a very 
mild regularity condition and finite second moment, -^[7?.e(S'„(i)), Xm(5'„(t))] are asymptotically 
independent normal random variables with mean and variance 7r/(i) for almost all t (here / is 
the spectral density of (Xj)jgz). The central limit theorem implies that /„ (t) / log log n converges 
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to in probability. An interesting and natural problem, that apparently has never been studied 
in depth before, is the law of the iterated logarithm, namely to identify in the almost sure sense, 
lim sup„_j.o2 /„ (t) / log log n for almost all t, or for a t fixed. In this paper, we study both these 
problems. We provide mild sufficient conditions on the stationary sequence that are sufficient to have 
lim sup„_^3c /„ (t) I log log n — f{t) almost surely. These results shed additional light on the importance 
of the periodogram in approximating the spectral density f{t) of a stationary process. The techniques 
are based on martingale approximation, rooted in Gordin jl5| and Rootzen [26] and developed by 
Gordin and Lifshitz |16) and Woodroofe [31j . combined with tools from ergodic theory and harmonic 
analysis. Various applications are presented to linear processes and their functionals, iterated random 
functions, mixing structures and Markov chains. 

We would like to point out that our results are formulated under the assumption that the under- 
lying stationary sequence is assumed to be adapted to an increasing (stationary) filtration. Results 
in the non adapted case could also be obtained. We shall also assume that our stationary sequence is 
constructed via a measure-preserving transformation that is invertible. Since our proofs are based on 
martingale approximation, we could also obtain similar results when the measure-preserving transfor- 
mation is assumed to be non invertible. In this situation, the conditions should be expressed with the 
help of the Perron- Frobenius operator associated to the transformation (see for instance [9]). In our 
paper we shall not pursue these last two cases. 

Our paper is organized as follows. Section [5] contains the presentation of the results. Section [3] is 
devoted to the proofs. Applications are presented in Section ID 

2 Main results 

Let {il,A,P) be a probability space. Assume, without loss of generality, that ^ is a countably 
generated cr-field, and let 9 : fl ^ fl he a, bijective bi-measurable transformation preserving P. Let 
J^o be a (T-algebra such that C 9~^{To). Let (J>i)nez be the non-decreasing filtration given by 
J^n = ^ "(-^o)) SLiid let J--.00 — Plfcez-^fe- along the paper Xq is a centered real random variable in 

which is J'o-nieasurable. We then define a stationary sequence {Xn,n e Z) by Xn ^ Xq o 9^. We 
denote Efc(-) — E{-\J^k) and Pk{-) = lEfe(-) — IEfc_i(-). Throughout the paper, we say that a complex 
number z is an eigenvalue of 9 if there exists /i 7^ in L^(P) such that ho 9 — zh almost everywhere. 
We say that A € A \s invariant if 9''^{A) = A. If for any invariant set A, P(y4.) = or 1, we say that 
9 is ergodic with respect to P, or equivalently that the stationary sequence is ergodic. 

Relevant to our results is the notion of spectral distribution function induced by the covariances. 
By Herglotz's Theorem (see e.g. Brockwell and Davis [3]), there exists a non-decreasing function G 
(the spectral distribution function) on [0, 27r] such that, for all j € Z, 

cov{Xo,Xj)= cxp{ij9)dG{9), jel. 
Jo 

If G is absolutely continuous with respect to the normalized Lebesgue measure A on [0, 2tt], then the 
Radon-Nikodym derivative / of G with respect to the Lebesgue measure is called the spectral density 
and we have 

cov{Xo,X,)= / expiij 9) f{9)d9, jeZ. 
Jo 

Our first theorem points out a projective condition which assures the law of the iterated logarithm 
for almost all frequencies. 

All along the paper, denote 

Yk{t) = (cos(fci)Xfe,sin(/ct)Xfe)', 
where u' stands for the transposed vector of u. 
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Theorem 1 Assume that 9 is ergodic and that 

5^M|,Eo(X.)|l^<oo. (3) 

k>2 

Then the spectral density, say f, of {Xk,k G Z) exists and for almost all t € [0, 27r), the sequence 
{ (t) /\/2n log log n, n > 3} is P-a.s. bounded and has the ball {x £ : x'x < Trf{t)} as its 

set of limit points. In particular, for almost all t G [0, 27r), the following law of the iterated logarithm 
holds 

limsup = f{t) P-a.s. 

n^oo log log n 

Note that condition (jSj is satisfied by martingale differences. It is a very mild condition involving 
only a logarithmic rate of convergence to of ||Eo(Xfe)||2. 

If we assume a more restrictive moment condition, ([3]) can be weakened. Define the function 
=log(e+|x|). 

Theorem 2 Assume that 9 is ergodic. Assume in addition that 

\L{L{Xo))) 

and that 

^^k{\og\ogk)^°°- 

Then the conclusions of Theorem\^hold. 

Note that condition ([3|), as well as condition implies the following regularity condition: 

E(XolJ--oo) = P-a.s. (5) 

We point out that this regularity condition implies that the process {Xk)ke'i is purely non determin- 
istic. Hence by a result of Szego (see for instance [TJ Theorem 3]) if ([5]) holds, the spectral density / 
of (Xfe)fegz exists and if is non degenerate, 

2-iT 

log f{t) dt > —oo ; 

in particular, / cannot vanish on a set of positive measure. We mention also that under Peligrad 
and Wu 21\ established that 

lim '^l'^"*^^''! = 27r/(i) for almost all te[0, 2tt) (6) 

n— f oo ri 

(see their Lemma 4.2). 

Both theorems above hold for almost all frequencies. It is possible that on a set of measure the 
behavior be quite different. This fact is suggested by a result of Rosenblatt [28] who established, on 
a set of measure 0, non- normal attraction for the Fourier transform under a different normalization 
than ^/n. 

We give next conditions imposed to the stationary sequence which help to identify the frequencies 
for which the LIL holds. As we shall see, the next result is well adapted for linear processes generated 
by iid (independent identically distributed) sequences. 
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Theorem 3 Assume that ([S]) holds and that 

WMXn) - Po(X„+i)|l2 < (X3 . (7) 

n>0 

Then the spectral density f(t) of {Xk,k € Z) is continuous on (0,2tt), and the convergence ([6]) holds 
for all t G (0, 27r). Moreover if 9 is ergodic, the conclusions of Theorem[l\ hold for all t € (0, 27r)\{7r} 
such that e~^** is not an eigenvalue of 6. 

Remark 4 The conditions of this theorem do not imply that the spectral density is continuous at 0. 
This is easy to see by considering the time series Xk = '^j>o j^^^^^k-j where {£k)kes. a sequence 
of iid centered real random variables in L^. For this case all the conditions of Theorem\^ are satisfied 
(see Section \4-l\ ) and var{Y^2=i -^k)/n converges to oo. This shows that the spectral density is not 
continuous at since otherwise we would have Var(^j.^-^ Xk)/n — > 27r/(0), which is not the case. 



We would like to mention that Condition ([7]) above was used by Wu [32] in the context of 
the CLT. We also infer from our proof and Remark [TUl that if ([5]) and ([7]) hold, and 9 is er- 
godic, then lim sup„_j.o2 /„ (tt) / log log n = 2/(7r) P-a.s. Moreover, it follows from a recent result 
of Cuny [S] that if 9 is ergodic, JS]) holds and ([7]) is reinforced to X]n>o ll^o(-^n)||2 < oo, then 
limsup„^^/„(0)/loglogn = 2/(0) P-a.s. 



We say that 9 is weakly-mixing^ if for all A,BgA, 

n-l 

n— ^-oo n 



n— 1 

lim - V \f{9-^A r\B)- V{A)F{B)\ = . 



k=0 

It is well-known (see e.g. [22l Theorem 6.1]) that saying that 9 is weakly mixing is equivalent to saying 
that 9 is ergodic and its only eigenvalue is 1. Let us also mention that when J--oo is trivial then 9 is 
weakly mixing (see section 2 of |22j). 

As an immediate corollary to Theorem [3] we obtain the following LIL for all frequencies. 

Corollary 5 Assume that 9 is weakly mixing and that ([5]) and ^ hold. Then the conclusion of 
Theorem[3i holds for all t € (0, 27r)\{7r}. 

Next theorem involves a projective condition in the spirit of Rootzen [26]. It is very useful in order 
to treat several classes of Markov chains including reversible Markov chains. 

Theorem 6 Assume that 9 is ergodic. Let t G (0, 27r)\{7r} be such that e^^** is not an eigenvalue of 
9. Assume in addition that 

sup||Eo(5„(t))||2 <oo. (8) 

Then 

and { X]fc=i Yk{t) / yy2n\og\ogn, n > 3} is P-a.,s. bounded and has the ball {x €E : x' x < crj/2} as 
its set of limit points. In particular, 

iJt) a? ^ 
lim sup , , =— P-a.s. 
n-s-oo log log n 2tt 

Remark 7 Note that in Theorem\^we do not require the sequence to be regular, i.e. it may happen 
that E(Xo|J^-„) does not converge to inlJ^ . The spectral density might not exist. 
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3 Proofs 



Proof of Theorem [H The proof is based on martingale approximation. By Lemma 4.1 in Pehgrad 
and Wu 21 , since Xq G and (O holds under ([3]), we know that for almost all t G [0,27r), the 
following limit exists in L^(P) and P-a.s. 



Hence setting for all £ E Z, 



D„it)= hm Ve*^-*Po(Xfc). (10) 

D,{t)=c'''Do{t)o0', (11) 

we get that for almost all t E (0,27r), {D^{t))fjzi forms a sequence of martingale differences in L^(P) 
with respect to (J^f)£gz- As we shall see, the conclusion of the theorem will then follow from Propo- 
sitions [S] and [TT] below. 

Proposition 8 Assume that 6 is ergodic. Let t G (0, 27r)\{7r} and assume that e^^** is not an 
eigenvalue of 9. Let D be a square integrable complex-valued random variable adapted to J-q and such 
thatE-i{D) ^0 a.s. For any k E Z, Zef dfe(i) = (7^e(e'''*L»o6''=),Im(e*'=*Do6''=))'. Then the sequence 
{ ELi dk (t) /\/2n log log n, n > 3} is P-a.s. bounded and has the ball {x E R"^ : x' ■ x < E(|D|2)/2} 
as its set of limit points. 

Remark 9 Since we assume A to be countably generated, then L^(0,yl, P) is separable and (see 
Lemma [^) 9 can admit at most countably many eigenvalues. Hence, Proposition^^ applies to almost 
all t E [0,27r). 

Remark 10 Let t ^ or t — and assume that 9 is ergodic. Then if D is a square integrable 
real-valued random variable adapted to J-q and such that E_i(Z)) = a.s., the following result holds: 
limsup„_j.oo I cos{kt)D o 0'^p/(2nloglogn) — E(_D^) a.s. For t — 0, it is the usual law of the 

iterated logarithm for stationary ergodic martingale differences sequences. For t — n, it follows from 
a direct application of 1 17, Theorem 1]. 

Proposition 11 Assume that condition ^ holds. Then, for almost all t E [0,27r), 

^ F-a.s. (12) 

y' n log log n 

where Mn{t) — X]fc=i ^fe(^) '^^'^ L)].{t) is defined by (jlip. 

To end the proof of Theorem [TJ we proceed as follows. By Proposition [Til it suffices to prove 
that the conclusion of Theorem [1] holds replacing Yfe(t) with dk{t) — {TZe{Dk{t)),Im{Dk{t))) . With 
this aim, it suffices to apply Proposition [8] together with Remark |9] and to notice the following fact: 
according to Lemma 4.2 in Peligrad and Wu [21], for almost all t E [0, 2tt), 

It remains to prove the above propositions. 

It is convenient to work on the product space. Let (51, P) = ([0, 2tt] x il, B ^ A, X (^F) where A 
is the normalized Lebesgue measure on [0, 2tt], and B be the Borel cr-algebra on [0, 27r]. Let t E [0, 2tt) 
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be a real number, fixed for the moment. Clearly, the transformation 9 ~ 9t (we omit the dependence 
with respect to t when t is fixed) given by 

9 : i-^ (w + t modulo 27r,6'(cj)), (13) 

is invertible, bi-measurable and preserves P. 

Consider also the filtration (J^„)„gz given by Fn ■= B ® Tn- 

Define a random variable on by Xq(u, lS) — &™Xq{uj) for every (u, w) e fi, and for any n e Z, 
Xn = ^0 o 6*". Notice that (^„)„gz is a stationary sequence of complex random variables adapted to 
the non-decreasing filtration {Tn). Moreover e™e™*X„(ti;) = X„(u,a;). 

Proof of Proposition H Let t e [0, 27r) be fixed. Let D{u) = e^"!? and Dk = D o 9''. 
Let dfe = {TZe{Dk),Im{Dk))' . Then 

-r , ^ / COSM — sinu \ , 
dk(u) — \ ■ d,k(t) . 

^ ' \^ smu cosu J '^^ ' 

Since the unit ball is invariant under rotations, the result will follow if we prove that for A-a.e. 
u e [0,27r], the sequence { ^fe (^) /•\/2" log log n, n > 3} has P-a.s. the ball {y S : y' ■ 

y < ll^olli/^} as its set of limit points, or equivalently (by Fubini's Theorem), if the sequence 
{ ELi ^fc / log log n, n > 3} has P-a.s. the ball {y e : y' ■ y < \\D\\l/2} as its set of limit 
points. 

According to the almost sure analogue of the Cramer- Wold device (see Sections 5.1 and 5.2 in 
Philipp (3^ ) , this will happen if we can prove that for any cc S such that x' ■ x = 1, 

limsup^ii£=i = Ml p_a.s. (14) 

n^oo v2n-loglogn 2 

To prove it we shall apply Corollary 2 in Heyde and Scott [XT' to the stationary martingale differences 
x' ■ do 9f. We have to verify 

^^(a;'.4)'^^ P-a.s. (15) 

fc=i 

In order to understand this convergence it is convenient to write 

D = A + iB. 

Therefore if x = (a, b)', 

(x' • dkf = {aTZe(Dk) + hlm{bk)f 
= (acos(ii + kt) + &sin(w + kt)f{A^ o 6''') + {bcos{u + kt) - asin(M + kt)f{B^ o 6*'=) 
+2(acos(u + kt) + 6sin(M + kt)){bcos{u + kt) - asin(u + kt)){A o 9''){B o 9'') . 

By using basic trigonometric formulas, it follows that if a; = (a, 6)' is such that -\-b^ = 1, 

. , ~,2 {A^+B'^)o9^ {a^ ~ b'^) cos{2u + 2kt) . , 
{x' ■ dkf = + ^ '-^ -{A^ - B^) o 9^ 

+ a6sin(2u + 2kt){A^ - B^) o 9'' + ab{cos{2u + 2kt) + sin(2u + 2kt)){A o 9''){B o 9'') 
+ {b^ - a^) sin(2u -I- 2kt)){A o 9''){B o e*'') . 
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By Lemma [35] applied with Iq — 2t, we derive that, for any t S (0, 27r)\{7r} such that e is not an 
eigenvalue of 6 then, for all u, 

lim - y ((x' • dk{u))^ ^(^' + o 0'=) = P - a.s. (16) 

Also by the ergodic theorem for 6*, 
1 " 

lim -y(A2 + B2)o5,fc =]E(|^|2 + |5|2) = j|£,||2 p_a.s. (17) 



n— >oo 7T, 

fe=l 



Gathering (IT6l) and p7)) . we get (IT5|) . This ends the proof of Proposition |8l □ 
Proof of Proposition llll 

Let 5o(u, •) e™2j^>oPo(e^''*Xfc) = Efe>o-Po(^fc) which is defined for A-a.e. t G [0,27r). Write 
= ELi ^fc, Mn = ELi 5o o ^^ and i?„ = 5„ - M„. 
Denote by E the expectation with respect to P. 

The next lemma follows from Corollary 4.2 in Cuny [7,. Notice that in [X,, complex- valued variables 
are allowed. 

Lemma 12 Assume that _ _ 

Y,Hn«^<^. (18) 

n>l 

Then ^ ^ 

Rn = o(\/n log log n) P-a.s. (19) 

To prove that ([T2l) holds, it suffices to prove that for A-a.e. t e [0,27r), ([T9| holds. According to 
Lemma [T2l it suffices then to prove that ([T8| is satisfied for A-a.e. t E [0,2tt). To this end, we first 
prove that 

/ E(|i?„ndt = 2V||Eo(Xfc)||2. (20) 

"'0 



fc=i 



Indeed, for almost all t E [0, 2tt) 



i?„(u,c^)=e™^e^^%(Xfc)(^)-Fe™ ^ e*'=*(Eo(Xfe)(w) - E„(Xfe)(c^)) . (21) 

fc=l fe>n+l 

Whenever the R.H.S. below converges, the following identity holds: 

•^0 k>n+l 

Then, using that E((Eo(Xfc) - E„(Xfe))2) = ||Eo(Xfe_„)lli - \\^o{Xk)\\l, and the fact that under ©, 
© holds, we obtain Using ((201), we see that under ©, for A-a.e. t E [0,27r), condition ^ 

holds. This ends the proof of (fT2|) and then of the proposition. □ 



Proof of Theorem [2l According to the proof of Theorem [l] it suffices to prove that under the 
conditions of Theorem [51 the almost sure convergence (|T5|) holds for almost all t E [0, 27r). With this 
aim, we shall use truncation arguments. Given 7 > and r > 0, we set for any integer 

Xi^r '■= Xt\s^\Xt\<2i^} - IE(X£l{|Xj,|<2T-}) 
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and 

fc>0 

We know that for almost all t e [0, 2n), Di^rit) is defined P-a.s. and in L^(P). 

We define non stationary sequences {X£)£>i and {D^{t))^>i as follows: for every r e N and every 
I g 1^2'', 2''+^ — 1}, 

Xr-^Xe,r,Di{t):^De,r{t). (22) 

Let also 

= Xe-Xe and = De{t) - Deit) . (23) 

Lemma 13 Assume that ^(^ ^°l(Xo)) ) ^^^n, /or a.e. i G [0, 27r), 

V p^"* conwerjjes P-a.s. (24) 

V^iloglogn 



/n particular, by Kronecker's lemma, for a.e. t e [0, 2n), ^'^~jQg log n ^ ^ P-a.s. 



log log n 

Proof. By Carleson's theorem in order to establish (p4)) it suffices to prove that 



E 



J^loglogn 



< oo P-a.s. 



This is true because 



^^nloglogn Hoglog^ "4^2 ^l^''l>'^''>^ floglog^ 

where we used Fubini in the last step and the notation a b means there is a universal constant 
C > such that a < Cb. □ 

Lemma 14 Assume that Ef^fc^) < oo. Then, for a.e. t E [0,27r), 



L{L{Xo))J 

Vnloglogn 

Proof. For almost all t £ [0, 27r), {D'^{t))i>i is a sequence of martingale differences in L^(P). Hence 
using the Doob-Kolmogorov maximal inequality, we infer that the lemma will be established provided 
that 

^\Di{t)r 



k>3 



V/ ^^p^dt <oo. (26) 
^ 'o fcloglogfc ^ ' 
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To prove it we use simple algebra and the projection's orthogonality, as follows: 



^Jo /clog log fc ^ 7o ^ log log ^ 



2''logr 7o ^ log log ^ 



~^2'-logr ^ 

T->2 ° £=2"^ 



2'' log r 

r>2 " £=2'- fe>0 



2^—1 

2-E^ E Eii(^-^(^"i{™>2.^}))°^'^li^ 



2'' log r 

r>2 ° f=2'- fc>0 



2 



= 27rETI^^(^ol{|Xo|>2-"-} -IE(Xol{|Xo|>2-"-}|-7^-oo))^ < 27rE t-^II^o1{|Xo|>2t-}||2 • 

r>2 *= r>2 ^ 

Next, using Fubini's theorem as done in ([M]) follows. □ 
From Lemmas [T^ and [T^ we then deduce that if E ^ l(°l(Xo°)) ) then, for a.e. t G [0, 27r), 



V n log log n 



P-a.s. 



Therefore, to prove that the almost sure convergence holds for almost all t E [0, 2tt) (and then 
the theorem) it suffices to prove that for almost all t E [0, 2tt), 

^ F-a.s. (27) 

y'n log logn 

where Sn{t) = J2]=i e'^^Xj and M„(t) = J2]=i Dj{t) where the Xj's and i?j(i)'s are defined in 
Let _ _ 

Rnit)=Snit)-Mn{t), 

and for any r G N, let 

Ar{t) sup \Rk+2^{t) - i?2--i(i)| . 

0<A;<2'--1 

Let New and let fc e]l, 2^]. We first notice that Arit) > \ ^^2-"^ e''^\'Xe -Diit))\, so if K is the 
integer such that 2^"^ < fc < 2^^ - 1, then 

K-l 



\Rk{t)\ < E ^-W- 



Consequently since K < N, 

N-l 



sup \Rk{t)\ < y2 Ar{t) . 

l<fc<2" ^^Q 

Therefore, p7p will follow if we can prove that for almost all t e [0, 2tt), 



sup |i?fe+2.-(t) - i?2^-i(t)| = o(2''/2 . (logr)i/2) p_a.s. 

0<fc<2'--l 
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which win be true if we can prove that 



T^r^rl ^E[^„< max ^_J^fcW- ^2^-1 WP]rft<oo. (28) 



r>0 

Notice that for any integer k in [2'', 2''+^ — 1] 



Therefore, by stationarity proving p8| amounts to prove that 

^FlL; rE(^maxJ^(X,,,,-i5,,(0)|>t<oo, (29) 

where ^^^^(i) = e'^'X^^^- Using Lemma [551 given in the Appendix with M = 2''"", we get that for any 
integer s > 1, 

(27r)-M E( maxj ^(X^,r -i5£,^(t))|^)dt 

Jo l<fc<2'- 

< 24 X 2'^||E_,(Xo)||2 + 24 X 2''||Xol|Xo|>2-.'-||' + I2s^2^^- . 

To prove (j29l) and then to end the proof of the theorem, we select 7 < 1/4 and use the above 
inequahty with s — [2''^] + 1. Using Fubini's theorem as done in (|25|) . we infer that p9)) wih be 
established provided that 

Ei^l|IE-P.i(Xo)ll^<c^. (30) 

r>2 

This convergence follows from condition ^ by using the fact (||E_„(Xo)|||)„>i is decreasing and by 
noticing that by the usual comparison between the series and the integrals, for any non-increasing 
and positive function h on and any positive 7, 

nr^hiin?) < 00 if and only if n^^h{n) < 00 . 

n>l n>l 

and that ([30]) is equivalent to En>3 »(iog\ogn) P-[«^](-^o)Hi < 00. □ 

Proof of Theorem [3l We divide the proof of this theorem in two parts. 

1. Proof of the continuity of / and of relation ([6]). Let {cn)nez denote the Fourier coefhcients 
of /, i.e. c„ := E(XoX„). Then, the Fourier coefficients of (1 — e'*)/(i) are (c„ — Cn+i)nei. and the 
Fourier coefficients of h{t) :— |1 — e''p/(t) are {bn)n& with 6„ = 2c„ — c„+i — c„_i, n G Z. 

One can easily see that h is the spectral density associated with the stationary process {Zn)nez ■= 
{Xn - Xn-i)n€Z, 1-6. 5„ = E(ZoZ„). Hcncc for n > 0, 

|6„| = |E(ZoZ„)| = |^E(P_fe(Zo)P-fe(Z„))| <^||P_fe(Zo)||2||P-fe-„(^o)||2. 

fc>0 k>0 

Therefore, 



^ |6„|=2^|6„|<2^(||P_„(Zo^ 

neZ\{0} n>l n>0 



|2f. 
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By ([7|) it follows that (6„)„gz is absolutely summable. Therefore, by well known results on spectral 
density, (see for instance Bradley |2j, Ch 8 and 9) h must be continuous and bounded on [0, 2tt], which 
in turn implies that / is continuous on (0, 27r). 

We prove now that ^ holds for every t e (0, 2tt). With this aim, it suffices to show that, for every 

(0,2^), \1 - e''\^E{\Snit)\^)/n ^ h{t). 

Define T„(t) := J2'k=i '^^^'^ ^k- It is easy to see, using the fact that c„ — > as n — > ±oo, that 

n\Tn{m \i-e^n\Sn{tr) ^ ^^^^^ 

(the little o is uniform in t G [0, 27r]). Now, by (4.6) of [21], (E(|r„(t)p/n)„>o is nothing else but the 
Cesaro averages of the partial sums of the Fourier series associated with h, hence it converges to h{t) 
by Fejer's theorem. 



2. End of the proof. 

By assumption ([7]), we have 



J2 I ^0 {Xk converges in . (31) 



fc>0 

Let t E {0, 2tt) be fixed. Using that Pq{X^i) = 0, we obtain 



fc-i 



m— m— m— 

k 

= (1 - e^*) Y e™*i^o(^m) + e^('=+i)*Po(Xfe) . 



m=0 



Since ||Po(-'^/c)||2 0, by (PT|) . we see that the series X]m=o ^™*-^o(-''^m) converges in as A: — > oo. 
Hence defining D[){t) by pO)) . it follows that {Do{t) o 6*^, £ G Z) is a stationary sequence of martingale 
differences in adapted to G Z). Hence the theorem will follow by Proposition [HI if we can 

prove that |S'„(i) - Mnit)\/y/nloglogn P-a.s. where Mn{t) = ELi e'''*-Do(i) o 6''. With this 
aim, we first notice that 



(1 - e'')Do{t) = Fo{t) where Fo{t) = Y e™*-Po(^m - ^m-i) • 

m>0 

Hence, writing Fk{t) = Fo{t) o 9'', we obtain the representation 

ji-i 

(1 - e'*)(5„(t) - M„(t)) = ^e*'=*(Zfe - Fk{t)) , 

fc=0 

where Zk = Xk — Xk-i- Therefore, the proof of the theorem will be complete if we can show that 

n-l 

I Y ^"'"'i^k - Ffe(<))|/v/nloglogn ^ P-a.s. (32) 

fc=0 

To prove this almost sure convergence, we shall work on the product space (fi, P) introduced in the 
proof of Theorem [TJ Recall that 9 has been defined in J"„ := B{[0, 2tt]) (g) and E stands for 
the expectation under P. 
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Define Zo{u,uj) := e™Zo(w) and Zk := Zq o 0'' . Similarly, define Fo{u,uj) = e'^Fo{t){uj) and 

:,>„Fo(^fe)=e^"Efc>o' 



Foo0^ Let Po(-) = E(-|J-o)-E(-|J-_i). Note that Fq = Efc>o^o(^fe) = e^" Efc>o e'''*^o(^fe - ^fc-i)- 



By assumption (O, we have 

^ ||Po(2'„)||2j < OO , 
n>0 

where || • p is the norm with respect to P. 

Therefore, by Theorem 2.7 of Cuny [8] (see (21) of [8j), identifying C with ]R^, we obtain that 



^(Zfc - Fk)\/^nlog\ogn ^ P-a.s. 



Now, Zfc(w, .) = e^e'^^'Zfc and hiu, .) = e^e'^^'Pfc, hence ([32]) follows. □ 

Proof of Theorem [6l Define an operator Rt on L'^{n,J'o,P) by Rt{Y) := e"Eo(y o 6) . Note that 
for every n > 0, = e™*Eo(r o 61"). Hence by assumption sup„>i || ELo^?(^o)||2 < 00 . By 

Browder Lemma 5], there exists Zq = Zo{t) € L^(J7, J^i, IP) such that 

Xo = Zo - RtiZo) = Zo - c'*E„{Zi) . (33) 

Now we denote Z^ = Zq o 0^ . Note that {Zk)k is a stationary sequence, Rt{Zo) = c**Eo(.^i) and we 
have the decomposition: 

Xo = Zo- E_i(Zo) + E_i(Zo) - e"Eo(Zi) . 
Denote the martingale difference I?o(i) = Zq — E_i(Zo) = Pq{Zq). So, 



^„(t) = ^e'*'=7^o(t)°e' + 5](e^*'Efe-i(^;.)-e^*('=+i)E,(Z,+i)) 

n 

= ^e**^7^o(t) o + e"Eo(Zi) - e'*("+i)E„(Z„+i) . 

k=l 

By the Borel-Cantelli lemma, 

|E„(z„+i)|/v^ = |E_i(zoi o r+VV^ ^ p-a.s. 

Therefore we have the following martingale approximation: 



1 " 

- {Sn{t) - ^ e'^'Doit) o e'') a.s. and in 



fe=i 

Hence, since e~^** is not an eigenvalue of 9, the proposition follows from Proposition[8]with i?(|DoP) = 
E{\Zo-E_,{Zo)n = al 

It is convenient to express at in terms of the original variables. With this aim notice that by 
equation (j33[) we obtain 

n n n 

Y^e'^'PoiXk) = 5]e'*'=Po(^fe) - 5]e^*('=+i'Po(^fc+i) 

fe=0 /c=0 fc=0 

= Po(Zo) - e^*("+i)Po(Z„+i) = Do{t) - e**("+i)Po(Z„+i) . 
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Since 

||Po(^„+i)||2 = \\MZn+i)\\l - ||E_i(Z„+i)||2 = |lE_„_i(Zo)|l^ - ||E_„_2(^0)|l2 , 
we obtain 

n 

Y,e'"'Po{Xk)^Do{t) in h\ 

This shows that, for this case, the representation ([TO)) holds for ah t e [0, 2tt] such that (|8]) is satisfied. 
□ 



4 Examples 

4.1 Linear processes. 

Let us consider the foUowing hnear process {Xk)k€Z defined by Xk ~ J2j>o^j^k~j where {ek)kez 
is a sequence of iid real random variables in and {ak)kez is a sequence of reals in i'^. Taking 
J-Q — cr{ek, fc < 0), it follows that Po{Xi) = aiSQ. Therefore ([7]) is reduced to 

^ |an - a«+i I < oo . (34) 

n>3 

Hence, because J^-oo is trivial, we conclude, by Corollary [SJ that the conclusions of Theorem [3] hold 
for all t G (0, tt) U (tt, 27r) as soon as ((M)) is satisfied. Let us mention that when a„ is decreasing 
is always satisfied. 

4.2 Functions of linear processes 

In this section, we shall focus on functions of real- valued linear processes. Define 

Xfc = ;i(^a,efe_,) -E(/i(^a,£fe_,)) , (35) 

i>0 i>0 

where (oi)igz be a sequence of real numbers in £^ and (£i)igz is a sequence of iid random variables in 
L^. We shall give sufficient conditions in terms of the regularity of the function h, for In{t) to satisfy 
a law of the iterated logarithm as described in Theorem [1] 

Denote by Wfi{., M) the modulus of continuity of the function h on the interval [— M, M], that is 

Wh{u, M) - snY>{\h{x) - h{y)l \x - y\ < u, \x\ < M, |y| < M} . 

Corollary 15 Assume that h is ^-Holder on any compact set, with Wh{u, M) < Cu^M"^, for some 
C > 0, 7 g]0, 1] and a > 0. Assume that 

^(logfc)2|afe|2^ < C30 and £(150^^'"+'^^) < oo . (36) 

k>2 

Then the conclusions of Theorem]^ hold with {Xk)kez defined by Ii35\). 

Proof. We shall apply Theorem[T]by taking = (j{ei,£ < fc). Since Xq is regular, ||Eo(Xi:)||2 = 
||P_^(Xo)||2. Therefore ([3]) is equivalent to 

5](log^)2||Po(X,)||2<oo. (37) 
e>2 
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Let e' be an independent copy of e, and denote by Ei^{-) the conditional expectation with respect to 
e. Clearly 



i=0 z>fc i—0 i>k 

Since Wh{ui + 1*2, M) < M) + Wf^{u2, M), it follows that 

|Po(^fe)| < Ee(2||Xo||oo A (wh (Iflfelkol, li^il V |y2|) + Wh i\ak\\e'ol l^il V iFsl) )) , (38) 



where Yi = X]i=o °-i^k~i + I]i>fe and Y2 = X^i^o + J2i>k o-iSk^i- Noting that (eo, l^il V 

IF2I) and (eQ,|Yi| V 1121) are both distributed as {eo,Mk), where Mk — max| J2i>o'^i^i ' '^''^o + 
Tlii^k '^i^i } ' and taking the L-^-norni in ([55)1 , it follows that ([57]) is satisfied as soon as (pS)) is □ 

4.3 Autoregressive Lipschitz models. 

In this section, we give an example of iterative Lipschitz model, which fails to be irreducible, to which 
our results apply. For the sake of simplicity, we do not analyze the iterative Lipschitz models in their 
full generality, as defined in Diaconis and Freedman [12 and Duflo |13j . 

For 6 in [0, 1[ and C in ]0, 1], let £{C,6) be the class of 1-Lipschitz functions h which satisfy 

h{0) = and \h'{t)\ < 1 - C(l + \t\y^ almost everywhere. 

Let [sijifzi be a sequence of iid real- valued random variables. For S >1, let ARC{C, 6, S) be the class 
of Markov chains on M defined by 

y„ = /i(y„_i) + En with h e C{C\ S) and e(^|^^^) < 00 . (39) 

(Recall that L{x) = log(e + |a;|)). For this model, there exists a unique invariant probability measure 
H (see Proposition 2 of Dedecker and Rio [11]). Moreover we have 

Proposition 16 Assume that {Yi)i^z belongs to ARC{C,d, S). Then there exists a unique invariant 
probability measure that satisfies 

L{L{x)) 

Applying Theorem 2 we derive the following result. 

Corollary 17 Assume that {Yi)i^z is a stationary Markov chain belonging to ARC{C,S, S) for some 
S > 2 + S. Then, for any Lipschitz function g , the conclusions of Theorem 1 hold for {g{Yi) — fi{g))i^z- 

Remark 18 The proof of this result reveals that an application of Theorem 1 would require the fol- 
lowing moment condition on ji: J \x\'^ L{x)^j,{dx) < 00 which according to the proof of Proposition [751 
is satisfied provided that E(|eo|'^L(eo)) < 00 for some S > 2 + S. 

Proof of Proposition 1161 To prove Proposition [TH we shall modify the proof of Proposition 2 
of Dedecker and Rio [IT as follows. Let K be the transition kernel of the stationary Markov chain 
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{Yi)i<£Z belonging to ARL{C,5,r]). For n > 0, we write K^^g for the function / g{y)K^{x,dy). Let 
'^i^) = l^l^ £(L(2)) - Notice that 

KV{x) = E(V^(r„+i)|y„ = x) = E(T/(/i(a;) + Eq)) < IE(^^(|/^(a:)| + koD) • 

By assumption on h, there exists Ri > 1 and some c G ]0, l/2[ such that for every x, with |a;| > 
|/i(a;)| < \x\ — cja;!^""^ := (7(2;) < |x|. Therefore, using the fact that for any positive reals a and b, 
log(e + a + b) = log(e + a) + log(l + b/{e + aj), we get for any > i?i (using that for u > 0, 
log(l + u) < u), 

S L{x) , , , , ,,s L{eo/{l + \x\) 



Vi\Hx)\ + \so\) < (gix) + \so\r——^^—--- + i\x\ + \eo\) 



LiL{\x\ + \eo\)) " ' ' L{L{\x\ + \eo\)) 

To deal now with the first term in the right hand side of the above inequality, we shall use inequality 
([M]) . in the Appendix, with a = g{x) and b = |£o|. We get that there exist positive constants c and 
i?2 such that for any \x\ > R2, 

^_5. L{x) o-s+ii^ if^fr-ws-i^:^^'^ 



Vm^)\ + kol) < (5(x))"t7773T + 2^+l£o|(5(x)) 



L{L{x)) ' "'^^^ " L{L{x)) 

Taking the expectation, considering the moment assumption on Eq a-nd using the fact that 5 G [0, 1[ 
and 5* > 1, it follows that there exist positive constants d and R such that for any |a;| > R, 



KV(x) < V{x) -d\x\ 



s~5 L{x) 



L{L{x)) 

So overall it follows that there exists a positive constant b such that 



KV{x) < V{x) - d \xf~^jp^ + bl[_nM^) . (41) 

This inequality allows to use the arguments given at the end of the proof of Proposition 2 in Dedecker 
and Rio [11 . Indeed, iterating n times the inequality (|^T|) . we get 

^ /" \..\s-s L{y) 



^7 L{L{y)) n n ^ 

and letting n tend to infinity, it follows that 

-^{dx) < bfx{[-R, R]) <oo . 



L{L{x)y 



□ 



< 00. 



Proof of Corollary [m Let X, = g{Yi) - ^(5). According to Proposition [HI e(^^ 

Hence Corollary [17] will follow from Theorem [2] if we can prove that the condition ([4]) is satisfied which 
will clearly hold if 

Y^n''\K-g{x)^^Ji{g)\''^l{dx)<<x. (42) 

n>0 
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According to the inequality (5.7) in Dedecker and Rio [TT], there exists a positive constant A such 
that 



IK^'gix) - fi{g)\ < An'-^/' / \x - y\fi{dy) + A{1 - B^{x)r j \x - y^dy) 

+ Ani-(^-i)/* l\x-y\ \y\'^~'-'^i{dy) , (43) 



where S„(x) = C[4(l + \x\ + {n - l)E|eo|)]"''- Noticing that E„>o ^^"^'"^"^'^^ < as soon as 
5 > 1 + (5 and that according to Proposition x"^ is /i— integrable as soon as S* > 2 + 5, we infer 
from (|43l) that (|42p wiU be satisfied if we can prove that 



n-^ 1 1-2(1 - Br,{x))^" fi{dx) < 00 . (44) 

n>0 

Notice that that (1 - B„(x))2" < exp(-2nB„(2;)). If |x| < 1, 



implying that 



exp(-2nB„(x)) < exp(-2Cn(8 + 4n)"'') , 
/ x^ e'Kp{^2nBn{x)) ^(dx) < oo . 



Now if |x| > 1, 



/CX3 
exp ( - 2Cu[4(l + |a;| + uE\eo\)]~^)du 

/oo 
u-^ exp ( - 2Cu|a;|-*[8 + u\x\-^E\e^^\)\-^)du 

/OO 
z-^ exp ( - 2Cz[8 + zE\eQ\)\-^)dz . 

Hence there exists a positive constant M such that 

/ Vn"iexp(-2nB„(a;))Ai(da;) < Af / x'^ iJ.{dx) , (45) 

J\x\>l J\x\>l 

which according to Proposition [16] is finite as soon as S > 2 + 5. All the above computations then 
show that (jHl) (and then (gS])) holds provided that S>2 + 5. □ 

4.4 Application to weakly dependent sequences 

Theorems [1] and [2] can be successively applied to large classes of weakly dependent sequences. In 
this section, we give an application to a-dependent sequences. With this aim, we first need some 
definitions. 

Definition 19 For a sequence Y — {Yijaz-z, where Yi ~ Yq o 9^ and Yq is an J- q -measurable and 
real-valued random variable, let for any fc € N, 

aY(fc) = sup ||E(1y^<„|J'o) - IE(ly^<„)||^ . 
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Remark 20 Recall that the strong mixing coefficient of Rosenblatt J^7\l between two a-algebras T and 
Q is defined by 

a{T,g)= sup \V{Ar\B)-F{A)¥{B)\. 
AeJ^.Beg 

For a strictly stationary sequence (Yi)iiz-^ of real valued random variables, and the a-algebra J-q = 
<^{Yi,i < 0), define then 

a(0) = 1 and a{k) = 2a{Fo,cT{Yk)) for k > . (46) 

Between the two above coefficients, the following relation holds: for any positive k, a^{k) < a{k). 
In addition, the a-dependent coefficient as defined in Definition \19\ may be computed for instance for 
many Markov chains associated to dynamical systems that fail to be strongly mixing in the sense of 
Rosenblatt Wi 



Definition 21 A quantile function Q is a function from ]0, 1] to M_(_, which is left- continuous and 
non increasing. For any nonnegative random variable Z , we define the quantile function Qz of Z by 
Qz{u) = inf{i > : P(|Z| X) < u}. 

Definition 22 Let ^ be the probability distribution of a random variable X . If Q is an integrable 
quantile function (see Definition \21\) . let Mon((5,/i) be the set of functions g which are monotonic on 
some open interval of IS. and null elsewhere and such that Q\g[x)\ ^ Q- Let Mon'^((3, /i) be the closure 

in E^{n) of the set of functions which can be written as X^fci '^ifi; where X^fci l*^^! — 1 ^'^'^ fi belongs 
to Mon{Q,n). 

Applying Theorem we get 

Corollary 23 Let Yq be a real-valued random variable with law Pyq, Cind Yi = Iq o 0*. Let Xi = 
f{Yi) -'E{f(Yi)) where f belongs to Mon''((3, PyJ with Q^L{Q)/L{L{Q))) integrable. Assume in 
addition that 

y TT / QHu)du < oo . (47) 

^fc(loglogfc)7o 

Then ^ is satisfied and consequently, the conclusions of Theorem]^ hold for (Xk)k<£Z- 
To prove that (|T7l) implies (U), it sufBces to notice that 

\\Eo{Xk)\\l=nXkE„{Xk))< / Q^{u)du 

Jo 

(see the proof of (4.17) in Merlevede and Rio [20] for the last inequality). 

The definition [22] describes spaces similar to weak L^* where we require a monotonicity condition 
plus a uniform bound on the tails of the functions. Let us introduce in the same spirit L^'-like spaces. 

Definition 24 If n is a probability measure onM. andp€ [2,00), M £ (0,oo), let yioiip{M , fi) denote 
the set of functions / : R — R which are monotonic on some interval and null elsewhere and such that 
A^d/I^) ^ -M^- Let MoHp^M , fi) be the closure mLP(/i) of the set of functions which can be written as 

Sfci ^ifi' where Y,i=i l^^l ^ 1 "'^'^ /c ^ Monp(M, ^). 

Let X, = f{Yi) - E{f{Yi)), where / belongs to Mon^+^-(M, PyJ for some (5 > 0. If 

^ (aY(fc))^/(^+^) _ 
2^ ■ ^- ■ <oo. 



fc>3 ^(loglog^) 



17 



then Corollary [23] applies. 

Application to functions of Markov chains associated to intermittent maps. 

For 7 in ]0, 1[, we consider the intermittent map from [0, 1] to [0, 1], which is a modification of 
the Pomeau-Manneville map [24 : 



T^{x) 



x{l + 2^x'^) ifa;e[0,l/2[ 
2a: -1 if a; e [1/2, 1] . 



Recall that T~f is ergodic and that there exists a unique T-y-invariant probability measure on [0, 1], 
which is absolutely continuous with respect to the Lebesgue measure. We denote by the Perron- 
Frobenius operator of with respect to . Recall that for any bounded measurable functions / and 
9, 

^lU ■ 9°T^)= '^■yi^7if)9) ■ 
Let {Yi)i>Q be a Markov chain with transition Kernel and invariant measure Vj. 

Corollary 25 Let 7 G (0, 1) and (Yi)i>i be a stationary Markov chain with transition kernel and 
invariant measure . Let Q be a quantile function such that 

' ^^^^,Q\u)du<^. (48) 

Let Xi = f{Yi) — iy-f{f) where f belongs to Mon'^ {Q , v^) . Then ^ is satisfied and the conclusions of 
Theorem]^ hold for (Xfe)A:gz- 

Remark 26 Notice that, by standard arguments on quantile functions, (j48p is equivalent to the fol- 
lowing condition: 

{x)dx < 00 , 



lo L{L{x)) 
where is the generalized inverse of Q. 

Proof. To prove this corollary, it suffices to see that (|35]) implies (|T7)) . For this purpose, we first 
notice that (|Tf)) can be rewritten in the following equivalent way (see Rio |25)): 



1 L{a^\u)) ^2 



L(i(aY ("))) 



Q {u)du < 00 , 



where a^^{x) ~ mm{q G N : ctYiq) < x}. Now, according to Proposition 1.17 in Dedecker et al. 
[lOj . there exists a positive constant C such that q;y^(u) < Cu~'^/'^^^'^\ Therefore, for any 77 e]0, l/2[, 
there exists a constant c depending on 7, C and 77 such that 



TIT I -1/ {u)du < c / Q {u)du 

L{L{a^'{u))) Jo L{L{u '')) 

Jo L{L{Q{u)) Jo L{L{u '')) 



which is finite under (l47l). □ 



In particular, if / is with bounded variation and 7 < 1, we infer from Corollary [25] that the 
conclusions of Theorem [T] hold for {Xk)kez- Note also that (|^ is satisfied if Q is such that Q{u) < 
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Cu-i/2(log(M-i))-i(loglog(u-i))-^ for u small enough and b > 1/2. Therefore, since the density h^^ 
of Vj is such that hi,_^ (x) < Cx~'^ on (0, 1], one can easily prove that if / is positive and non increasing 
on (0, 1), with 

C 

fix) < n_^w2|, — ^-TTT, n — near for some b > 1/2, 

2;U T^/^l log(a;)|(log I log^a;)!)" 

then (HHl) holds. 



4.5 Application to a class of Markov chains 

We shall point out next some consequences of Theorem |6] in terms of stationary Markov chains 
characteristics. Let T be a regular transition probability on the measurable space (S,iS), leaving 
invariant a probability fj, on (S,5). We also denote by T the Markov operator induced on L^(/i) via 

Tg{x) = / g{y)T{x,dy) 
Js 

and we assume that it is ergodic (i.e. Tf = f fj, a.e. for / > implies / is constant fi a.e.). Let 
(Cn)nez be the (stationary) canonical Markov chain with state space (S, 5) associated with T, defined 
on the canonical space {n,A,P) = (S^,5'^^,P) (the law of under P is /x). Denote by the shift on 
n. Denote by J-n = < n). 

Corollary 27 Let (fn)„gz be a stationary Markov chain. Let h G L^(S,/i) centered and define Xk = 
h{^k)- Let t G (0, 27r)\{7r} he such that e^** is not in the spectrum ofT, and e^^** is not an eigenvalue 
of T . Then the conclusions of Theorem\d\ hold for {Xk)k<£Z- 

Remark 28 In Corollary we do not assume the regularity condition ||r"7i||2,;x — > 0. The spectral 
density might not exist. 

Proof of Corollary 1271 By assumption, there exists g G L^(§, /i) such that h — g — e^*Tg. Therefore, 

n 

Eo(5„(t)) - ^Eo(e^*'=5(a) - e^'^''+'^ g{^k+i)) = e^'Mgi^i)) " e"("+i)Eo(g(6.+i)) , 
fc=i 

showing that condition ([8]) is satisfied. Hence, for t G (0, 27r)\{7r} such that e~^'' is not an eigenvalue 
of 6 (the shift on f2), the proposition will follow from Theorem |6l To end the proof we notice that if 
e~^** is an eigenvalue for 9, it is an eigenvalue for T, see e.g. Proposition 2.3 of Cuny (notice that 
the proof there extends easily to L^) □ 

We give now a consequence of Corollary [27] for reversible Markov chains. This follows from the 
fact that the spectrum of T is real and lies in [—1,1]. 

Corollary 29 Let {Cn)nez be a stationary and reversible Markov chain (T — T*). Let h G L^(§, /i) 
centered and define Xk = /i(Cfc)- Then the conclusion of Theorem\B holds for every t G (0, 27r)\{7r}. 

The (independent) Metropolis Hastings Algorithm leads to a Markov chain with transition function 

T{x, A) = p{x)S^{A) + (1 - pix)HA) , 

where Sx denotes the Dirac measure at point a;, is a probability measure on S and p : S — > [0, 1] is a 
measurable function for which ^ = i-p(^x) ^i'^x) < oo. Then there is a unique invariant distribution 

/^(^^') " aft ^ f w '^ 
e{l-p{x)) 

and the associated stationary Markov chain (^i)i is reversible and ergodic. Hence Corollary applies 
to this example. 
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5 Appendix 

5.1 Facts from ergodic theory 

We first recall the following consequence of the Dunford-Schwartz ergodic theorem, see sections VIII. 5 
andVIII.6 of [II. 

Proposition 30 Let (fi, P) he a probability space and be a measure-preserving transformation on 
n. Let s e M. For every X € L^{n,A,F), there exists ns{X) € l.^{n,A,¥) such that 

- n— 1 

-y^e'^'XoO'' — ^ TT,{X) P-a.s. (49) 

fe=0 

and m L^{n,A,¥). Moreover, tTs{X) od = e-'"7r^(X) P-a.s. 

Remark 31 It follows from the Wiener- Wintner theorem that the set of measure 1 in (|49p may be 
chosen independently of s, but we shall not need that refinement. 

Proof. Define an operator Vs on L,^{n,A,F), by Vs{X) — e'^'^X o 9. Then, Vs is a contraction of 
which also contracts the h°° norm. Hence we may apply |14i Theorem 6 p. 675], to obtain the almost 
sure convergence. The L-'^ convergence follows from [TU Corollary 5 p. 664] (see also the proof of the 
next lemma). □ 

We also give the following lemma, that should be well-known. We give a proof for completeness. 

Lemma 32 Let {n,A,¥) be a probability space and 9 be a measure-preserving transformation on fl. 
Let to E M. be fixed. If there is no non trivial Y G h'^{ft,A,F), such that Y o 9 ^ e^'*°y P-a.s., then, 
for every X G L"'^(r2, P) Trtg{X) = ¥-a.s. Furthermore, when lJ^(rt,A,P) is separable, there exists 
a countable (at most) set S C M such that for every t G M\S and every X e l,^(Q,A,P), T^tiX) = 
P-a.s. 

Proof. Define Vtg as above. Since sup„>i i|| J2k=o ^t^Wh^^i^^ < by the Banach-principle, the set 
y := {X e {n, A,F) : ||iX;fc;oG*'=*"-'^°^'''lli ^OjisclosedinLi. Now, by von Neumann's mean 
ergodic theorem 

L2(r!,AP) - {I-Vt„)h^n,A,P)®Fi^Vt,, 

where FixVtg stands for the fixed points of Vt„ in L^(ri,^,P) and the closure is in norm || • ||2. By 
assumption, Vtg has no non trivial fixed point. Obviously, y contains (/ — Vt„)L^(ri, y^, P), hence 

y = ]L\n,A,F). 

Assume now that ]L'^{n,A,F) is separable. Define an operator on ]L'^{n,A,F) by UX ^ X o 9. It 
is well known that the eigenspaces of U corresponding to different eigenvalues are orthogonal. By 
separability there are at most countably many eigenvalues for U, hence the result. □ 

5.2 Technical approximation results 

Lemma 33 Assume that Xq is almost surely bounded by M . For any integer s > 1 

(27r)"i / E( max \Si{t) - Mi{t)\^)dt < 12(m||E_^(Xo)||^ + s^M^) , 
Jo i<^<™ 

where Mn{t) — X]fc=i ^fc(i) ^'^'^ D^it) is defined by (jlip . 



20 



The proof of this lemma follows from the following result (which is of independent interest) by 
selecting aj = 1 for < j < s — 1 and Uj ~ for any j > s. 



numbers nonincreasing smaller than 1 with J^'jLi < °o and — 1. Then 



Lemma 34 Assume that Xq is almost surely bounded by M . Let (a„) be a sequence of positive 

oc 

j= 



(27r)-i / E( max |S'£(t) - M^(t)p)dt < 12(my (a^-^i - aj)|lE_j(Xo)|p + M^fV 
Proof of Lemma! 



N 2 

a 



Step 1: Martingale decomposition. 

We start with a traditional martingale decomposition (see for instance Section 4.1 in Merlevede, 
Peligrad and Utev [1^). Let i e [0, 2tt) and Xk{t) = e^^^Xk- 

oo oo 

^fe(t) = X,(i) + ^a,E,(X,+,(0); e'^,(t) =Y,a, ^u{Xu+m 

and 

oo 

Efe(0fc+i(t)) - 6k(t) = -Xk{t) + ^(flj-i - aj)¥.k(Xk+j{t)) . 

Finally, denote by 

oo n 

D'k+iit) = ek+i{t)-Ek{ek+im = ^a,Pfe+i(Xfe+,+i(<)) ; A^t) - J] • 

j=0 k=l 

Then, {D'i,{t))kez is a sequence of martingale differences with respect to the stationary filtration 
(J"j)jgz. Note 

oo 

Xk{t) = D'^+,{t) + Okit) - e,+,{t) + ^(a,_i - a,)Ek{Xk+,{t)) . 
Taking into account the definition of 0j,(<) we can also write 

oo 

Xk{t) = D',{t) + e'^_,{t) - 9'^{t) + ^(a,_i - a,)Ek^,{Xk+,-i{t)) . 

3 = 1 

It follows that for almost all i G [0, 27r), 

t oo £—1 oo 

Sdt) - Me{t) = ^ ^(a, - l)Pfc(Xfe+,(t)) + ^ ^(a,_i - a,)E,(X,+,(t)) + 0[,(t) - 0',{t) 

k=l j=0 k=0 j=l 

= I + II + 9',{t)-e'„M- (50) 

5<ep ^; T/ie estimation of Jp^Emaxi<f<,„ |S'£(i) — Mg{t)\'^dt. 

We shall estimate separately this maximum for all the terms in the decomposition (I5(I1) . 
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By the Doob-Kolmogorov martingale maximal inequality, stationarity, Fubini theorem and orthog- 
onality of e**'' the first term will be (remind ao — 1) dominated by 



(27r)-i / E max \I\'^dt < {27r)-^m / E\D'„{t) - Do{t)\'^dt 

Jo l<e<m Jq 

= {2ny^m E\^{aj -l)Po{Xj{t))\^dt 

Jo . n 



j=0 

OO 



By simple computations, 



^(a, - f)2||P_,Xo|f = J2ia, - l)2(||E_,(Xo)|p - ||E_,_i(X, 



0^11^) 



(ai - f)2||E_i(Xo)|p + ^[(a, - f)2 - (a,_i - f)2]||E_,(X, 



o;il^ 



i=2 



^[(a, - f)2 - (a,_i - f)2]||E_,(Xo)|p < 2^(a,_i -a,)||E_,(Xo) 
j=i i=i 



So 

r.27r 



{2tt)-^ / E max \I\^dt < 2m V(aj_i - aj)||E_j(Xo)||^ . (51) 
Jo i<e<m. ^ 



By Cauchy Schwarz inequality the second term is estimated as follows. 

(.27T <X1 OO .271 



f f ^ 

/ E max llll'^dt < V(a^_i - aA V( ) / E max I Ve'('=+^')*Efe(Xfc+,)Pdt. 

^=1 j = i "'U fc=0 



By Hunt and Young maximal inequality 

„27r OO m — 1 



(27r)"i / E max \II\^dt < ^(flj-i - flj) ^ ||Eo(X 



OO 

= m^(a,_i-a,)||Eo(X,)||2. (52) 
i=i 

The last terms are estimated in a trivial way as follows: 

(2^)-W E ma^xJ0^,(^)-0U^)^rf^ = 4A^2(^a,)^ (53) 

"'0 - -™ 

Gathering dSI]), ([521) and the lemma follows. □ 
5.3 An algebraic inequality 

Lemma 35 For any positive reals a and b and any real S > 1, 

{a + bf <2'^b'^ + a^il + 2'^+^b/a). (54) 
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Proof. To prove the above inequality we first notice that if a < 6, the inequality is trivial. Let then 
assume that b < a. The Newton binomial formula gives 

(a + bf < a^{l + 6/a)[^l+i < a^(l + b/a ^ C^s]+i{b/a)''-^) < a^(l + 2^+^b/a) . 

fe=i 

□ 
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